Wp 2004/109598 



PCT/IB2004/050767 



Inteipolation of images 



FIELD OF THE INVENTION 

The invention relates to a mettiod of interpolating pixel values of pixels of an 
image. Hie invention further relates to a warped distance interpolator, and to a display 
apparatus comprising such a warped distance interpolator. 

5 

BACKGROUND OF THE INVENTION 

The warped distance concept (WaDi) is known fix>m the publication ''Warped 
distance for space-variant linear image interpolation", IEEE Transactions on Image 
processing, vol. 8 no. 5, May 1999 by G. Ramponi. The Warped Distance concept for linear 

10 interpolators ad^ts a linear interpolator to the local pixel configuration of natural (non 
graphic) images. Particularly, the aim was to prevent edges from being blurred by the 
interpolation process. 

The WaDi concept performs a one dimensional interpolation. In the horizontal 
direction, an interpolated sample could be a linear combination of the two neighboring 

15 horizontal samples sandwiching the sample to be interpolated. The linear combination 

depends on the firactional position (or phase) of the sample to be interpolated with respect to 
the two neighboring horizontal samples. Tlie interpolation at a luminance edge is adapted by 
locally warping the phase, such that the sample to be interpolated is virtually moved toward 
the right or left input sample. This warping is stronger in presence of luminance edges and 

20 less on smooth parts. In order to determine the amount of warping, four pixels around the one 
that has to be interpolated are analyzed, and an asymmetry value is computed such tfiat the 
sample to be interpolated is moved towards the flat area it belongs to. 

An uiterpolation of a 2D image is obtained by first performing the WaDi 
algorithm on the input samples in the horizontal direction to obtain interpolated horizontal 

25 samples and then in the vertical direction on the interpolated horizontal samples. It is a 
disadvantage that a relatively complex algorithm is required. 
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SUMMARY OF THE INVENTION 

It is an object of the invention to perfonn a WaDi interpolation on a two- 
dimensional image which provides a higher performance algorithm. 

A first aspect of the invention provides a method of interpolating sample 
5 values of samples of an image as claimed in claim 1 . A second aspect of the mvention 

provides a waiped distance interpolator as claimed m claun 7. A third aspect of the invention 
provides a display apparatus as claimed in claim 8. Advantageous embodiments in 
accordance with the invention are defined in the dependent claims. 

The method of interpolating sample values of samples of an image determines 
10 a direction of a local gradient for a particular one of the sample fix>m sample values 

neighboring the particular one of the samples. This local gradient indicates flie direction of 
change of the values of the samples at the position of the particular sample. For example if 
the image comprises a white left area and a black right area and the particular sample is near 
to a vertical border between Ihe white and the black area, the gradient will duect m the 
15 horizontal direction towards the white area. Usually, the local gradient is determined for each 
ou^ut sample of the image. 

Then, a warping factor for a warped distance interpolator WaDi is determined 
using interpolator input values arranged in the gradient direction of the particular sample. 
Thus, the interpolator input values for the well known WaDi interpolator are selected on a 
20 line which extends through the particular sample in the direction of the local gradient 

Because usually, these interpolator input values do not coincide with the input 
samples, the interpolator input values have to be interpolated fix>m input sample values 
neighboring the interpolator input values. 

The determination of the warping fiictor in tiie direction of the local gradient 
25 has the advantage that the WaDi mterpolation can be performed in one step, instead of 

performing the WaDi mterpolation step successively in the horizontal and vertical direction. 

In an embodiment in accordance with the invention as defined in claim 2, the 
WaDi interpolation is applied m a system in which an ou^ut unage is a scaled input image. 
This approach is particularly mterestmg for scalmg &ctors which are at least 2, which means 
30 that the distance between the output samples is at most half of the distance between input 

samples. The distance may refer to the time elapsed between two successive samples or to the 
actual position on a display screen when these samples are displayed on the pixels of the 
display screen. 
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In this embodiment, the otitpnt image is first roughly interpolated fiom the 
input image to obtain raw interpolated data, for example by using a simple bilinear 
interpolator. The resultant low-pass version of the image makes the gradient estimation less 
susceptible to noise. A more complex interpolation, for example a cubic inteipolation, may 
5 be used but has the drawback that a higher computational complexity results. The local 
gradient is determined by using the output pixels or raw interpolated data supplied by the 
simple interpolator. 

In tiie embodiment in accordance with the invention as defined in claim 3, the 
local gradient is determined m the input mzp by using the input sample values. The local 
10 gradients found are mapped to output sample positions of the output samples m the output 
map. This mappmg may be performed, for example, by using the nearest neighbor approach, 
or by linear interpolation. This approach does not require the raw interpolation step and &us 
takes less computational efiTort. 

In the embodiment in accordance with the invention as defined in claim 4, the 
IS samples are arranged in a matrix in which the position of the samples is defined by the 

ordiogonal x, y coordinates. Well known Sobel filters are used to estimate the direction of the 
local gradient 

In the embodfanent in accordance with the invention as defined in claun 5, the 
distance between the adjacent interpolator input values used to determine the gradient is 
20 substantially equal to the distance between adjacent input samples to provide a coherent 
interpolation. 

In the embodiment in accordance with the invention as defined in claim 6, the 
warping &ctor is projected on the x and y coordinates to control tiie WaDi mterpolator to 
modify the distances (to warp the samples m the time domain or the pixels in the space 

25 domain) in the x and in the y direction m accordance with the projected warping factors. 

Thus, instead of performing the standard WaDi algorithm two times, first in the x direction to 
obtain intermediate results, and then m the y dbection using tiie irrtermediate results, the 
components of the single warping &ctor are used to directiy obtain the int^polated output 
samples fix>m the input samples. 

30 These and other aspects of the invention are apparent fi'om and will be 

elucidated with reference to the embodiments described hereinafter. 

BRIEF DESCRIPTION OF THE DRAWINGS 
In the drawings: 
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Fig. 1 shows a known two step interpolation ^proach. 

Fig. 2 shows a wavefonn for elucidating the known Warped Distance concept. 

Fig. 3 shows, for a particular output sample, the arrangement of the 

interpolator input values in the direction of the local gradient in accordance with an 
5 ^bodiment of the invention. 

Fig. 4 shows a flowchart for elucidating an embodiment of the one step 

Warped Distance concq)t in accordance with the invention. 

Fig. S shows a flowchart of part of another embodiment of tiie one step 

Warped Distance concept in accordance with the invention, and 
1 0 Fig. 6 shows a block diagram of a display apparatus comprising the Warped 

Distance interpolator in accordance with the invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
Fig. 1 shows a prior art two step interpolation approach. 

15 In well known linear interpolation techniques, a two-dimensional input image 

n (see Fig. 6) is represented by input samples Pi which usually are sampled equidistant such 
that the input samples Pi are positioned on a rectangular grid which has a x and a y direction. 
Hie input samples Pi are also referred to as input pixels Pi which is based on the feet that if 
the input samples Pi were displayed on a display screen DS (see Fig. 6), the rectangular grid 

20 in time would show as a rectsmgular grid in position on the display screen DS. The values of 
tiie input samples Pi determine the intensity of the input pixels Pi. Hie output samples Po 
actually to be displayed on the display screen DS may have to be interpolated from the input 
samples Pi to obtain output pixels Po corresponding to the pixels on the display screen DS. 
This is for example required if die resolution of the display screen DS is fixed, such as is the 

25 case for matrix displays and the resolution of the input image n diffo^ from the resolution of 
the display screen DS. 

Fig. 1 shows the interpolation of an output sample Po which is positioned in- 
between input samples PL The value of tiie i-th mput sample Pi of the j-th row of samples of 
the input image is denoted by fCxi,yj). The value of the ou^ut sample Po is denoted by 

30 fb(x,y). In Fig. I the four input sanq)les Pi are shown which are nearest to the output sample 
Po. 

First, tiie input image n is interpolated in the horizontal direction x. In the row 
yj, the value ft(x,yj) of a temporary sample Ptl is determined using the value fl[x4,yj) of the 
input sample Pi in the colunm X{ and the value f(xi+i,yj) of the input sample Pi in the column 
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xi+i. In the same manner, in the row jj^-i, the value ft(x,yj+i) of a temporary sample Pt2 is 
determined using the value f(3Q,yj4^i) of the input sample Pi in the column Xi and the value 
f(xff i,yjf i) of the mput sample Pi in the column Xi+i . Then, the value fo(x,y) of the output 
pixel Po is determined using the temporary samples Ptl and Pt2. 
5 The values of the temporary samples Ptl and Pt2 may be calculated as 

ft(x,yk) = (1-Sx) f(xi,yk) + Sx fl[xw,yk) k - j, j+1 (1) 
wherem Sx is the distance in the x-direction between x and Xi. 

The value of the output sample Po may be calculated as 
fo(x,y) = (1-Sy) fi(x,yj) + Sy ft(x.yi.i) (2) 
1 0 wherein Sy is the distance in the y-direction between y and yj. 

Fig. 2 shows a waveform for elucidating the known Warped Distance concept 
In the same manner as elucidated wifli respect to Fig. 1, the Warped Distance concept 
(further referred to as WaDi) determines the value of the output sample Po in two steps. The 
difference with the linear interpolation elucidated witib respect to Fig. 1 is that the distances 
IS Sx and Sy are adapted (warped) according to a local feature of the input image II to increase 
the perceived quality of the interpolated output unage OI (see Fig. 6). Thus, the WaDi 
interpolates the input image n by applying first the linear interpolation algorithm in the x- 
direction with an adapted distance Sx to obtain temporary or intermediate interpolated 
samples Pt Then, the WaDi ^plies the linear interpolation algoritiim m the y-direction on 
20 the intermediate interpolated samples Pt with an adapted distance Sy to obtain the output 
sample Po. 

The WaDi warps the distances Sx and Sy based on de warping factor A: 
A-(|a3-al |-Ia4.a2 |)/(L-1) (3) 
wherein the coefficients al to a4 are input sample values ^xi,yj) m the neighborhood of the 
25 output sample Po to be interpolated. Depending on the stqp performed by the WaDi, tiie input 
samples al to a4 are arranged either in the x or in they directioxL L is the number of levels 
available to display the samples, for example, for 8 bit luminance signals, L = 256. 

Fig 2 shows a waveform and input samples Pi for elucidating the WaDi in tiie 
x-dhectiorL The function ^x) shows an example of a transition m the input video image n. 
30 Particularly, the aim of the WaDi was to prevent edges from being blurred by 

the interpolation process. If the intermediate sample Pt to be mterpolated is m a position u 
(not shown) in the output domain, the corresponding position of the output sample Po in the 
input domain is x==u/z, wherein z is the scaling factor. The mput domain comprises the input 
pbcels Pi and the output domain comprises the output pbcels Po. The fractional position or 
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phase Sx = x-xo, wherein xo is the left hand input sample Pi next to x. This input sample Pi at 
xo has a sample value a2, the input sample Pi at xi has the value a3, the input sample Pi at x.i 
has the value al and the input sample Pi at X2 has the value a4 which is 1 in the examples 
shown. If a simple tent (bilinear) kernel is applied as the base kernel of the linear interpolator 
5 of tiie WaDi, the ou^ut value would be: 

Mx) = (1 - Sx)fix^ ) + Sxfix^ ) = (1 - Sx)a2 + Sxa3 (4) 

wherem xi is the right hand input sample next to x. 

10 Generally speakmg, the interpolated sample ft(x) is a linear combination of the 

neighboring samples fi[Xo) and ^xi), which linear combination depends on the fiactional 
position (or phase) Sx. The interpolation at a luminance edge is adapted by locally warping 
the phase Sx, such that x is vutually moved toward the right or left mput sample Pi. This 
warping is stronger in presence of luminance edges and less in smooth parts. In order to 

15 determine the amount of warpmg, the four samples Pi at positions x-i, x©, xi and X2 around 
the sample at position x that has to be interpolated are analyzed, and an asymmetry value or 
warping ftictor A is computed: 

^^_ |/(^t)-/(^-i)h|/(>:2)-/(^o)L|a3--alh|a4-^a^^ 

20 

wherein L is the number of allowed luminance levels (256 in case of 8 -bit quantization). And 
X.I is the input sample preceding the input sample xq, and xj is the input sample succeeding 
the input sample xi. Provided the sigmoidal edge model applies, the asymmetry value A in 
equation (5) is 0 when the edge is perfectly symmetric, and close to 1 (or -1) when the edge 
25 is more flat in the right (left) hand side of the sample Pt 

The sample Pt to be interpolated should be moved towards the flat area it 
belongs to. Therefore, when the warping fector A>0, the phase Sx has to be increased, while 
if the warping &ctor AO the phase Sx has to be decreased. This is obtained by the followii^ 
warping fimctton: 



(6) 
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where k is the general amount of warping which may be controllable. The warped phase Sx* 
remains in the range [0,1], if k is in the range [0,1], It has to be noted that the two «tremes 
Sx=0 and Sx=l are maintained (Sx'=0 and Sx*=l, respectively), regardless the value of A 
and k. The warped intermediate sample is indicated as WP. 
5 In the same maimer as elucidated for determining the warped intermediate 

samples WP by performing the known WaDi in the x direction, the WaDi has to interpolate 
the warped intmnediate samples WP in the y-duection to obtain the ou^ut sample Po. 

Changing the phase Sx is equivalent to moving the position of fte sample to 
be interpolated Pt or Po in the intermediate or ou^ut grid, respectively, before applying the 

10 linear filter equation of Ae WaEH, as if it were warped. Actually, the final position of the 
samples Pt or Po is not changed, the algorithm assigns to the sample to be interpolated Pt or 
Po the value obtamed as if it were in the warped position. The factor k controls the amount of 
warping, a greater value of k increases the sharpening efiTect To be sure that the phase Sx lies 
within the interval 0 to 1, the fector k has to be selected < 1. But, for natural images, the 

15 factor k is preferably larger than 1. Because [ A | is usually small, even at these larger fectors 
k the phase Sx is still smaller than 1 . If the phase Sx becomes larger than 1 it is clipped to 1, 
or if it becomes smaller than 0 it is clipped to 0. 

In an embodiment in accordance with the invention, compared to the known 
WaDi, the warpmg function is determined only once, in the direction of a local gradient (Q) in 

20 either the input image or the output image. 

Fig. 3 shows, for a particular output sample, how the interpolator input values 
al to a4 may be arranged in the direction of the local gradient in accordance with an 
embodiment of the invention. The input samples Pi are indicated by the large dots spaced 
over distance d m the x, y space. The output samples Po are indicated by the intersections of 

25 the horizontal and vertical lines which form &e output grid. Fig. 3 thus shows, by way of 
example, a scalmg with a fiu^or 2. The line TR indicates the border between a black area (at 
the left hand side of the border TR) and a white area. The direction of &e local gradient at the 
position of ike output pixel P is indicated by the dotted line DLO which is perpendicular to 
the border TR. 

30 The invention is based on changing the phases Sx and Sy , not according to 

local 1 -dimensional features in the x or the y direction, respectively, but from 2-dimensional 
features. Thus, the warpmg factor A is calculated in one step along the local gradient 
direction 6 which may be diagonal. It is not required to determine a factor A separately in the 
x-direction and in the y-direction. 
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As discussed with respect to the known WaDi, the asymmetry value or 
warping factor A is still calculated by using input values al to a4 which are positioned in the 
neighboriiood of ttie output sample P of which the value has to be determined. But, in 
accordance with an raibodiment of the invention, these input values are neither the input 
5 samples Pi in the x-direction nor the warped temporary samples Pt in the y-direction. Now, 
the input values al to a4 are arranged in the direction of a local gradient 9. As shown in Fig. 
3, the mput values al to a4 used to determine the warping &ctor A are positioned on the line 
DLG, ttius in the direction of the local gradient 8. Usually, these uiput values al to a4 will not 
coincide with input samples Pi and thus will have to be interpolated from the input samples 

10 Pi. Preferably, the distance d between two successive ones of the input values al to a4 is 
equal to the sampling period of the samples Pi of the input image n to keep coh^ience with 
the image interpolation stage. 

Ttiis sampling period corresponds to tiie distance d between two successive 
input samples Pi in either the x or the y direction. For ^cample, the input values al to a4 are 

IS obtained by a bilinear interpolation in the positions shown in Fig. 3. These positions of the 
input values al to a4 are selected along the maximum gradient direction 9, at distances - 
1.5 d, -0.5 d, 0.5 d, 1,5 d, respectively, from the (xp,yp) position of the output pfacel P to be 
interpolated, wherein d is the distance between two successive input pixels Pi in the input 
grid. The coordinates x and y of the input values al to a4 are determined with the following 

20 equations: 

x = Xp+(i- 2,5)d • cos(0) 

wherein i is the index of the input value ai. 

Two possible embodiments are elucidated for determining the local gradient 0. 
In the first embodiment, the input image n is first interpolated with a known algorithm, for 
25 example with a bilinear filter, to obtain rou^ly interpolated output samples. The local 
gradient 9 is determined in the output domain fix>m these ou^ut samples. For example, by 
using a Sobel filter. Possible masks of Sobel filters to obtain a value of the durectional 
derivative along x and y directions are: 



Sobel^ = 



(1/4 0 -1/4 
1/2 0 -1/2 
1/4 0 -1/4 



Sobel^ = 



-1/4 -1/2 -1/4^ 
0 0 0 
1/4 1/2 1/4 



30 



The direction of the gradient 0 at tiie position xi,yj is then estimated as follows: 
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e{x,,yj) = arctan((/l*5ofe/,) \(x,,yj)/(fl*Sobel,) \ix,,yj)) (7) 
wherein fl is the result of &e rough interpolation of the input unage n, and 0 is an angle 
Miiich varies between -k/2 and nf2. 

The gradient evaluation has been performed by using Sobel's meQiod in &e 
5 output domain. A pre-processing, for example a simple bilinear mt^polator, is required to 
obtain raw interpolated output samples which represent a low-pass version of the input image 
n and thus the gradient estimation is less noise-sensitive. The rough interpolation may be 
performed with more complex methods, for example, such as a bicubic interpolation, which 
of course has the drawback that a higher computational complexity is required but which 
10 provides better gradient values 0. Although this first embodiment provides a very good 
gradient estimate, it adds a considerable oveAead to the total processing time. 

In another embodiment, a less optimal solution to estimate the gradient 9 is to 
apply the Sobel filters in the input domain (using tiie input samples Pi) and then map these 
gradient values to the output grid. TTiis mapping may be performed, for example, by using the 
1 S nearest neighbor approach, or by linearly mterpolating the estimated gradient values 8. 

If very high values of the interpolation &ctor are required, the pass band of 
Sobel filter could become too laige and the gradient estimation would not woik. For high 
interpolation &ctors, it is thus better to resize &e image in two steps, performing the whole 
algorithm twice. For example, an interpolation by a factor of 8 may become an interpolation 
20 by a cascade of interpolations by a factor of 2. Altematively, the Sobel filters may be used to 
process a mid-resolution version of the input image II to obtain gradient values 0. The same 
gradient values 6 are assigned to a group of output pixels Po in the ultra-high resolution 
output grid. 

Fig. 4 shows a flowchart for elucidating an embodiment of the one step 
25 Warped Distance concept in accordance with the invention. 

The step 1 receives the input samples Pi(i j) and supplies local gradients 
e(m,n) (also referred to as gradients). In the first embodiment as elucidated before, the step 
10 interpolates the input pixels Pi(ij) to obtain estimated output samples r(ni,n) which are 
inputted mto the Sobelx filtering step 1 1 and the Sobely fittering step 12. In the dividing step 
30 13, the output of the Sobely filtering stepl2 is divided by the output of the Sobelx filtering 
step 1 1. Step 14 determines the gradient e(m,n) by calculating the arctan of the ou^ut of the 
dividing step 13. 

The step 2 performs tiie local asymmetiy estimation also referred to as 
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the determination of the warping factor A, In step 20, the four input values al to a4 are 
selected to be determined in positions along the direction of the local gradient 0, thus on the 
line DLG. P(m,n) is the output sample of which the value has to be interpolated, and e(P) is 
the local gradient at the position of this output sample P(m,n). In step 21, the values of the 

5 input values al to a4 are determined by mterpolation of the input samples Pi surrounding the 
positions of the input values al to a4. Preferably, a bilinear interpolation is used. In step 22, 
the warping factor A is determined according to equation 5 in one step from &e interpolated 
ii^ut values al to a4. 

The step 3 determines the values of ttie output samples Po(iJ). Step 30 

10 receives the gradients 6(m,n) and the warping factor A to compute die local warping 

components or distances SLx and Sly by warpmg the distances Sx and Sy in. the same manner 
as equation 6 (tid for the known WaDi approach. To obtain tiie result, the warping vector A is 
projected onto the x and y direction. The following equations perform these operations: 

15 SL, = + iWcos(fl)/4 (8) 

SLy^Sy-^kisinieyA (9) 



As in the knovm WaDi approach, k is a multiplying &ctor that adjusts the 
distortion intensity, 6 is the angle which defines the gradient direction. The optional &ctor 4 

20 at the denommator is provided only for comparison with the known WaDi results. Note that 
die k &ctor can be varied on a sample-per-sample (or if referring to the ou^ut pixels on a 
pbcel by pixel) basis, by means of an (external) automatic control. For example, a natural 
content detector can be used to estimate the probability whether the local pixel is part of a 
photograph. Depending on this estimate die warping effect can be tuned via the k &ctor to 

25 obtain the best result 

The optional clipping step 31 clips the values of the local warping distances 
SLx and Sly to keep them in a range from zero to one, including the limits. Otherwise, it may 
h^pen, especially if the multiplying fector k>4, that tiie warping distances SLx or SLy are 
smaller than zero or greater than one which means that the output pixel Po to be interpolated 

30 would move outside the square formed by the four nearest input pbcels Pi, which will not 

provide a good mterpolation. The clipped warpmg distances are denoted by SLCx and SLCy. 

It has to be noted that based on equations 8 and 9, that if the phase SxH) and 
the phase Sy^, and if A is not zero, the warping distances SLx and SLy may not be equal to 
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zero. Thus, output pixels Po(m,n) interpolated in points of the output grid that correspond to 
points in the input grid may have a value different fiom the corresponding input samples 
Pl(iJ). Therefore, the adapted WaDi algorithm in accordance with the invention is an 
approximate interpolation algorithm. 
5 The interpolation step 32 interpolates the input samples Pi(iJ) with an 

interpolator which preferably uses a linear kernel. The clipped warping distances SLCx and 
SLCy determine how the ou^ut sample Po(m,n) has to be interpolated by weighting the 
adjacent mpxxt samples Pi(i j) in the same mann^ as in the know WaDi. 

The warped position x%y' in which the value f(x\y') of the output sample or 
1 0 pixel Po(x,y) has to be evaluated is influenced by three &ctors: 

the coordinates x,y of the ou^ut pixel Po we are interpolating, 
the direction 9 of the local gradient which constrains the position of the input 
values sd used to calculate the warping factor A, and 

the value of the warping strength parameter k. 
IS Fig. 5 shows a flowchart of part of another embodiment of the one step 

Warped Distance concept in accordance widi the invention. Fig. 5 shows the steps required in 
the step 1 which determines the direction of the local gradient 0(m,n) in accordance wi-fti the 
second embodiment discussed before. Now, step 1 comprises the steps IS and 16 instead of 
the steps 10 to 14 shown in Fig. 4. In step IS, the direction of the local gradients B(iJ) is 
20 determined in the input image II for the input samples Pi. The step 16 maps these local 

gradients 6(iJ) from the input domain to the output domain to obtain local gradients G(m,n) 
for the output pixels Po. The other steps of the WaDi processing of this embodiment in 
accordance with tiie invention are equal to tiie steps shown in Fig. 4. 

Fig. 6 shows a block diagram of a display apparatus comprising the Warped 
2S Distance interpolator in accordance with the invention. An input video processor IVP 

processes mput video IV to obtain the input image n comprising the input samples Pi. If the 
input video IV comprises the three RGB signals, the mput video processor IVP may comprise 
a matrix for determining the luminance value. The scaler WI comprises the WaDi 
interpolator in accordance with the invention which is the known WaDi interpolator which is 
30 adapted to be able to process two-dimensional input images II in one step. The scaler WI 

supplies the output image OI which comprises the output samples Po. Such a scaler is usually 
required in display apparatuses which comprise a matrix display. Such a matrix display has a 
native resolution determined by the number of pixels (display elements) in each row and the 
nimiber of rows. On the other hand, the input image II has a resolution which may differ from 
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the native resolution of the matrix display. Hius, the output samples Po to be displayed on the 
pixels of the matrix display have to be interpolated from the mput samples Pi. The scaler WI 
may receive the input video IV to be able to mterpolate each of the three signals R, G and B, 
if present. The ou^ut video processing processes the ou^ut video OI to obtain a video drive 
5 signal VDS suitable to drive the display device DP comprising the display screen DS. 

To conclude, the preferred embodiment in accordance with the invention is 
du-ected to a digital processor which performs the next steps in the order given. 

Interpolate 10 the input image n with a predetOTnined fiast interpolation 
method to obtain a roughly int^polated output image r(m,n) comprising temporary ou^ut 

1 0 samples Pot The temporary ou^ut samples Pot are determined for the purpose of usmg them 
to calculate tiie local gradient direction 0(m^) and are not meant to be displayed. 

Calculate the local gradient direction e(m,n) in tiiis roughly mterpolated output 
unage r(m^) with a simple algoritiim such as tiie Sobel filters 11 and 12, the divider 13 and 
tiie arctan calculator 14, but other algorithms may also be used. 

1 5 Determine 21a number of interpolated input values ai along tiiis gradient 

direction G(m,n) from the input samples Pi(iJ) of the mput image U in selected 20 
predetermined positions located around the ou^ut pixel Po(m,n) we want to interpolate. Use 
these input values ai to match the edge model of the WaDi approach by calculating 22 the 
warping fector A. Use this warping fiictor A to calculate the warpmg along the gradient 

20 direction G(m,n). 

Project 30 the calculated warping along the gradient direction 0(m,n) on the x 
and y axis, and perform a clipping 3 1 if necessary. Apply 32 the projected x and y warping 
components on the values of the phases Sx and Sy (representing the ofi&et of the ou^ut 
samples Po(m,n) to be interpolated with respect to the closest upper-left mput pfacels Pi(i J)) 

25 to calculate the warped position of the output sample Po(m,n). Use 32 a linear filtering 

technique to mterpolate the ouQmt sample value Po(m,n) in the warped position accordingly. 
The ou^ut samples Po(m,n) are used to be displayed. 

The WaDi algorithm in accordance with the invention could be used every 
time an interpolation processing is reqmred of photographic images or video. The algorithm 

30 performs best when scaling factors greater than 2 are required. For example, the algorithm 
may be used in video- wall q)plications, in photo-retouching software and other context It 
could also be useful inside integrated cuxniits, such as, for example controllers of digital 
display systems. The algorithm could be implemented both in real time and batch processing 
applications. 



wo 2004/109598 



PCT/ro2004/050767 



13 

It should be noted that the above-mentioned embodiments illustrate rather than 
limit the mvention, and that those skilled in the art will be able to design many alternative 
embodiments without dq>arting from the scope of the appended claims. 

Although the WaDi processing m accordance with the invention has hem 
5 described for grey scale images, the same processing can be used for color images. If the 
WaDi processor receives RGB (Red, Green and Blue) input signals, the warped distances Sbc 
and SLy may be calculated by using the lununance value determined from the RGB mput 
signals. The difference is that in tiie last step 32, the interpolation is applied three times, on 
each one of the RGB signals separately using the same values of the warped distances SLx 
10 and SLy or the clipped warped distances SLCx, SLCy. 

In the claims, any reference signs placed between parentheses shall not be 
construed as limiting the claim. Use of the verb "comprise" and its conjugations does not 
exclude the presence of el^ents or steps other than tiiose stated in a claim. The article "a" or 
"an" preceding an element does not exclude the presence of a plurality of such elements. The 
15 mvention may be implemented by means of hardware comprising several distinct elements, 
and by means of a suitably programmed computer. In the device claim enumerating several 
means, several of tiiese means may be embodied by one and the same item of hardware. The 
mere feet that certain measure are recited in mutually different dependent claims does not 
indicate that a combination of these measures cannot be used to advantage. 
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